GEVREY REGULARITY OF SUBELLIPTIC MONGE-AMPERE EQUATIONS 
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Abstract. In this paper, we establish the Gevrey regularity of solutions for a class of 
degenerate Monge- Ampere equations in the plane, under the assumption that one principle 
entry of the Hessian is strictly positive and an appropriately finite type degeneracy. 



1. Introduction 

In this paper, we study the regularity problem for the real Monge- Ampere equation 

det(D 2 w) = k(x), xeflc R d , (1.1) 

where Q. is an open domain of M. d , d > 2. We consider the convex solution u of equation 
(11.11 ). then k is a nonnegative function. In the case when k > 0, the equation (11.21 ) is elliptic 
and the theory is well developed. For instance, it's shown in HI that there exists a unique 
solution u to the Dirichlet problem for (ll.ll ). smooth up to the boundary of Q., provided 
that k is smooth and the boundary dQ. of Q. is strictly convex. In the degenerate case, i.e., 

= {x e O; k(x) = 0, Vk(x) = 0} * 0. 

The equation (11.11) is then a full nonlinear degenerate elliptic equation. The existence and 
uniqueness of the solution for the Dirichlet problem of the equation (11.11 ) have already 
been studied in ifTOl . Also in lfT2l . they proved that the Monge- Ampere equation has a C°° 
convex local solution if the order of degenerate point for the smooth coefficient k is finite. 

As far as the regularity problem is concerned, a result in fT9l proved that, for the de- 
generate Monge- Ampere equation, if the solution u e C p for p > 4 (so that it is a classical 
solution), then u will be C°° smooth. 

However, in general, the convex solution u to (11.11) is at most in C • if A: is only smooth 
and nonnegative (see (H for example). To get a higher regularity, some extra assumptions 
are needed to impose on k. This problem has been studied by P. Guan [9] in two dimension 
case, in which the smoothness of C°° for a C 11 solution u of the equation (11.11 ) is obtained, 
if k vanishes in finite order, i.e. k ~ x 2e + Ay 2n with I < n,A > 0, and one principal 
curvature of u is strictly positive. In a recent paper ifTTTl . the last assumption is relaxed to 
the bounding of trace of Hessian from below, i.e., Au > Co > 0. For such C°° regularity 
problem, see also earlier work of C.-J. Xu |[T8l which is concerned with the C°° regularity 
for general two-dimensional degenerate elliptic equation. In a recent work lfT3l . the authors 
extended Guan's two-dimensional result of |9] to higher dimensional case. 

It is natural to ask that, in the degenerate case, would it be the best possible for the 
regularity of solution here to be C°° smooth? One may expect that, in case of coefficient 
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k with higher regularity, the solution u would have better regularity than C°° smooth, we 
will introduce the Gevrey class, an intermediate space between the spaces of the analytic 
functions and the C°° functions. There is well-developed theory on the Gevrey regularity 
(see the definition later) for nonlinear elliptic equations of any order, see Q for instance. 
For the linear degenerate elliptic problem, there have been many works on the Gevrey 
hypoellipticity of linear subelliptic operators of second order (e.g. J4[ |5l] and the reference 
therein). The difficulty concerned with equation (11.11 ) lies on the mixture of degeneracy 
and nonlinearity. 

In this paper, we attempt to explore the regularity of solutions of equation (11.11 ) in the 
frame of Gevrey class. We study the problem in two dimension case 

UxxUyy - uly = k(x,y), (ij)en, (1.2) 

and assume that u yy > 0, then we can apply the classic partial Legendre transformation 
(see lTT6l for instance), to translate the equation (11.21 ) to the following divergence form 
quasi-linear equation 

d ss w(s, t) + d t (k(s, w(s, t))d t w(s, t)} = 0. (1.3) 

This quasi-linearity allows us to adopt the idea used in [2], to obtain the Gevrey regularity 
for the above divergence form equation. In order to go back to the original problem, i.e., 
the Gevrey regularity for the equation (I1.2I ). a key point would be to show that the Gevrey 
regularity is invariant under the partial Legendre transformation, which will be proved in 
Section [3] 

Now let us recall the definition of the space of Gevrey class functions, which is denoted 
by G°"([/), for cr > 1, with U an open subset of M. d and cr being called Gevrey index. 
We say that / e G°\L0 if / e C°°(U) and for any compact subset K of U, there exists a 
constant Ck, depending only on K, such that for all multi-indices a e Z+, 

Wf\\L~(K) <C l f\\a\\r. 

The constant Ck here is called the Gevrey constant of /. We remark that the above inequal- 
ity is equivalent to the following condition: 

\\d a f\\ LHK) <& K ]+ \\ a \\y. 

In this paper, both estimates above will be used. Observe that G l {U) is the space of real 
analytic functions in U. 

We state now our main result as follows, where Q. is an open neighborhood of origin in 

R 2 . 

Theorem 1.1. Let u be a C ' weak convex solution to the Monge- Ampere equation rti.2D . 
Suppose that u yy > cq > in Q. and that k(x, y) is a smooth function defined in O, satisfying 

c~\x 2e +Ay 2n ) <k(x,y) <c(x 2t +Ay 2n ), (x,y) g O (1.4) 

where c > 0, A > and £ < n are two nonnegative integers. Then u € G e+1 (Q), provided 
k € G e+1 (Q.). 

Remark 1.2. If k is C°° smooth and satisfies the condition M. 41) . and u yy > 0, P. Guan 
has proved that a C ' solution of the equation di.2D will be C°° smooth. In 111 IB . 
the assumption that u yy > is relaxed to the bounding of trace of Hessian from below, 
i.e., Au > cq > 0, but the assumption di.4D is changed to A > and I = n. Our main 
contribution here is to obtain the Gevrey regularity G . 
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Remark 1.3. The regularity result of main theorem seems the best possible, since in the 
particular case of £ = 0, we have u e G l (Q.) (i.e., the solution is analytic in Q.), and 
in this case the equation M. 21) is elliptic, thus our result coincides with the well-known 
analytic regularity result for nonlinear elliptic equations. We can also justify that if k is 
independent of second variable y (then A — 0), the equation < \1.3\) is linear, it is known 
that, see 0], the optimal regularity result is that the solution lies in G f+1 . 

Remark 1.4. The extension of above result to higher dimensional cases and more general 
models of the Monge-Amere equations with k = k(x, u, Du) is our coming work. By using 
the results of 111 3B . the idea is the same. 

The paper is organized as follows: the section|2]is devoted to proving the Gevrey regu- 
larity for the quasi-linear equation d 1.3b - In Section |3] we prove our main result by virtue 
of the classic partial Legendre transformation. We prove the technical lemmas in Section 

SI 

2. Gevrey regularity of quasi-linear subelliptic equations 

In this section we study the Gevrey regularity of solutions for the following quasi-linear 
equation near the origin of R 2 

d ss w + d t (k(s, w)d t w) = 0. (2.1) 
We assume that k(s,w) satisfies the condition 

C -\s 2t + Aw 2n ) < k(s, w) < c(s 2e + Aw 2n ), (2.2) 

where c > I, A > are two constants and I < n are two positive integers. Since Gevrey 
regularity is a local property, we study the problem on the unit ball in K 2 , 

B = [(s,i) | s 2 + t 2 < l), 

and denote W = [-1, 1] X [HMI^m, IMI^g)]. We prove the the following result in this 
section. 

Theorem 2.1. Suppose that w(s, f) e C°°(B) is a solution to the quasi-linear equation 
rfZTT) . and that k e G e+i (W). Then w e G M (B). 

We recall some notations and elementary results for the Sobolev space and pseudo- 
differential operators. Let H"(M, 2 ), k € R, be the classical Sobolev space equipped with the 
norm || • \\ K . Observe ||-|| - l|-|lz. 2 (3R 2 )- Recall that H K (R 2 ) is an algebra if k > 1. We need 
also the interpolation inequality for Sobolev space: for any e > and any r\ < ri < rj,, 

\\h\\ r2 < s\\h\\ r3 + E-^- r ^- n) \\h\\ n , V h € H r3 (R 2 ). (2.3) 

Let U be an open subset of R and S a (U),a e R, be the symbol space of classi- 
cal pseudo-differential operators. We say P = P(s,t,D s ,D t ) e Op(S a (U)), a pseudo- 
differential operator of order a, if its symbol o-(P)(s,t;£,rf) e S a (U) with (£,rj) the dual 
variable of (s, t). If P e Op(S a (U)), then P is a continuous operator from H*(U) to 
Hf~ a (U). Here H K C (U) is the subspace of H K (R 2 ) consisting of the distributions hav- 
ing their compact support in U, and Hf~ c a (U) consists of the distributions h such that 
<ph e H K ~ a (R 2 ) for any (f> e C^(U). For more detail on the pseudo-differential opera- 
tor, we refer to the book 0J1. Remark that if Pi e Op(S a '), P 2 € Op(S" 2 (U)), then 
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[Pi, P2] e Op(S ai+ " 2 ~ l (U)). In this paper, we shall use the pseudo-differential operator 
A r = (l + \D S \ 2 + \D t \ 2 y of order r.rel, whose symbol is given by 

In the following discussions, we denote, for P e Op(>S a ), 

ML = £ \\ pff, A and to* = Z ■ 

M=m |y|=; 

We consider the following linearized operator corresponding to (12.11 ) and the solution 

w, 

£ = <9„ + 5,(^(5, t)d t ■ ), 
where i) = k(s, w(s, ?))■ To simplify the notation, we extended smoothly the function 
k to K 2 by constant outside of B, similar for k. We have firstly the following subelliptic 
estimate. 

Lemma 2.2. Under the assumption 42.21 ). for any reR, there exists C r > such that 

\\v\\ 2 , + ||5 s A r vg + llfcsfltA'vllg < C r \\\Lvt , + ||v||g) , (2.4) 
/or anv v e C™(B), where C r depends only on [k]jg, < j < 2. 

Remark 2.3. By using Fad di Bruno's formula, [k]jg is bounded by a polynomial of 
[k\wdw] U B^<i<j. 

Proof. Firstly, we study the case of r = 0. Observe 

Rvllo + \&d t v\§ = \\d s v\\l + f Ks, t)\d t v(s, tfdsdt = - (£v, v) . (2.5) 

JR 2 

Then the assumption (12.21 ) implies 

\\d s v\\ 2 + \\/d t v\\l < c{ \\dM\l + \&d t v\\ 2 } = -c(Xv,v) . 
Since the vector fields {d s , s d t ] satisfies the Hormander's condition of order {, we get (see 

HEED) 

IMI 2 ^ < Co{ ||<Vllo + \0d t v% + IMlg} = -Co (Xv, v) + ColMlo- ( 2 -6) 

f+i 

By Cauchy-Schwarz inequality, we have proved (12.41) with r = 0. Since we have extended 
k to R 2 , (0) 62) also hold for any v £ S(R 2 ). 
Now for the general case, we have 

P,.A'v|| 2 + \0d t K r v\\l = -(A r £v, A r v) - ([k, A r ]8 t v, d t A r v) 

<\\Zv\\ 2 , +||v|| 2 , -([k, A r ]8 t v, d t A r v). 

r f+i r+ 1+\ x ' 

Since for v e C~CB), we have A r v € 5(R 2 ). Then dHJ) implies 

Ni , +\\d s A r v\\ 2 Q + \0d t A r v\\l (2.7) 

"~ f+i 

^ Co {lIXvll 2 + ||v|| 2 - (ft A r ]d t v, d t A r v)) . 

We consider now the commutator [k, A r ], the pseudo-differential calculus give 

o-([k, AD = %JtsJ)a$„oiA%,Ti) + oiR2Xs,t,e,v), 
M=l 
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with o-(R 2 ) e S r ~ 2 (M, 2 ) and 

\(R 2 d t v, d t A r v)\ < C 2 \\v\\ 2 r , 
where C 2 depends only on [ k ] g, < j < 2. Thus 

([k, A r ]d t v, d t A r v) < C ||v|| r {||(cU)5,A'v|| + ||(^) d t A r v\\ J + C\\v\\ 2 r . 



Moreover, note that k is nonnegative, and hence we have the following well-known in- 
equality 



\d s ~k(s,t)\ 2 + \d t k{s,t)\ 2 < 4[~k] 2M 2~k(s,t). 



(2.8) 



For the sake of completeness, we will present the proof of the above inequality later. By 
Cauchy-Schwarz inequality and interpolation inequality (12.31 ). one has 

t i ) + C r \\v\\ 2 . 



([k, A r ]d t v, d t A r v)< -L{\pd t A r - 



+ ||v|| 
'^e+T 



Thus Lemma [2721 follows. Now it remains to show (12.81) . For any h e R, the following 
formula holds 

1 _ , 

k(s + h, t) - k(s, t) + d s k(s, t)h + -o ss k(so, t)h , sq € R. 

Observe k > 0, then for all /j e R we get < k(s, t) + d s k(s, t)h + \{ k h^h 2 . So the the 
discriminant of this polynomial is nonpositive; that is, 

\d s k(s,t)\ 2 <2[k] 2M 2~k(sJ). 

Similarly \d,k(s, t)\ 2 <2[k h,R2k(s, t). This gives (|2?8T ). □ 

Remark 2.4. With same proof, we can also prove the following estimate 

IMI L + ^ + E (ll^^HIo + \0d t A r d a v\\ 2 ^ < Q m {||£v|f +m _^ + ||v 

\a\<m 

for any v e C™(B). 

A key technical step in the proof of Gverey regularity is to choose a adapted family of 
cutoff functions. For < p < 1, set 

B p = {(s, t)\ s 2 + t 2 < 1 - p} . 

For each integer m > 2 and each number < p < 1, we choose the cutoff function (p pM 
satisfying the following properties: 



supp (p Piin c B ( m-i)p, and <p p , m (s, t) = 1 in B p , 
m k 

sup WippJ < Cfclf ) . 

(s,f)eB F 



(2.9) 



For such cut-off functions, we have the following 

Lemma 2.5 (Corollary 0.2.2 of [5 ]). There exists a constant C, such that for any < k < 4, 

and any f € S(R 2 ), 



IK-)4^ C C) J| 



' m 
+ 1- 



< ; < 2. 



(2.10) 



We prove now Theorem 12. ll by the following Proposition. 
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Proposition 2.6. Let w e C°°(B) be a smooth solution of the quasi-linear equation rt2.il) . 
Suppose k € G C+1 (R 2 ). Then there exists a constant L, such that for any integer m > 5, we 
have the following estimate 



\\f P , m d m w\\ 2+ ^ + \\d s A 2+m f P , m d m w\\o + md t A z+ ^<P P , m d m w 



2+ 



f+i 
r m— 2 



P' 



,{M)(m-3) 



- ((m-3)!/ +1 , 0< j<€+l, 0<p<l. 



(2.11) 



Remark 2.7. The constant L in Proposition \2.6\ depends on i, [w] 8 g, the Gevrey constant 
ofk, and is independent ofm. 

As an immediate consequence, for each compact subset K c B, if we choose po = 
^dist (K, dB). Then <p PCh m = 1 on K for any m, and (12.111) for j = yields, 

/ \m+l 



\d m w\ 



lHk) 



(m\) M , V m e 



This gives m € G e+i (B). The proof of Theorem 12. H is thus completed. 



The proof of Proposition 12.61 is by induction on m. We state now the following two 
Lemmas, and postpone their proof to the last section. 

Lemma 2.8. Let k e G c+l (R 2 ) and w e C°°(B) be a solution of equation d2.il ). Suppose 
that for some N > 5, f !2.iil ) is satisfied for any 5 < m < N— 1, and that for some < jo < I, 
we have 



<PpJfd N w\\ 2+ n + 



./o-i 



k-2d t A 2+ ^(p PtN d"w 



/o-i 



C Q L 



N-3 



N\ J0 / xf+i 
- ((iV-3)!) , V0< P <1, 



(2.12) 



where Co « a constant independent ofL,N. Then there exists a constant C\ independent 
ofL, N, such that for any < p < 1, 

C L N ~ 3 I A/V 0+1 e+\ 
INp^M 2+4 h <^^(-j ((*-3)!) ■ (2-13) 

Lemma 2.9. Le? e G e+l (M?) and w e C°°(B) be a solution of equation f !2. i D . Suppose 
that for some N > 5, (12.1 1\) is satisfied for any 5 < m < N— 1. T/jen there exists a constants 
C2 independent ofL,N, such that 



\\-Cf P ,Nd 



N-l 



C 2 L 



N-3 



N-l 

P 



((AT- 4)!) 



(+1 



(2.14) 



for allO <p<\, 0<j<€ + l. 

Here and throughout the proof, C and Cj are used to denote suitable constants which 
depend on £, [k] B , [w] 8 ^ and the Gevrey constant of k, but it is independent of m and L. 

Proof of Proposition 12.61 The proof is by induction on m. Firstly by using (I2.10I ). the 
direct calculus implies, for m = 5, all < p < 1 and all integers j with < j < ( + 1, 



\Pp,md m w\ 



d s A 2+ ^f P , m d m w 



+ 



kW t A 2+ ^Vp, m d m w 



Mi 
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with Mi a constant depending only on [£] £> [ w ]sb an( ^ tne constant C in (12- 10b . Then 
(12.111 ) obviously holds for m < 5 if we choose L>M\. 

Now we can finish the proof of Proposition I2.6l by induction, for any N > 5 

Claim :( \2.11\) is true for m = N if it is true for all 3 < m < N - 1. 

We prove this claim again by induction on j, for < j < I + 1 . 
Case of ; - 0: We apply Remark El with r = 2 - ^ m = 1 and v = (p pM d N " l w e C~(5), 

\\<P P Md N w\\ 2 2 + \\d s A 2 -^f P ,Nd N w\\ 2 + ||^ 5 ,A 2 -^^^ W ||2 

< \\<P P ,Nd N - l w\\ 2 2+l + \\d s A 2 '^d l (^ N d N ' l w)\\ 2 Q 

+ \0d t A 2 -^d\ip p , N d N ' y w)\\l + C \\{d^ P , N )d N - { wf 3 _^_ 

< c 3 jllx^^Vg^ + ii^jv^-Vii^ + \(d l ^ N )d N - 1 

By the induction assumption, we use now Lemma 12791 to get 
\\£^Nd N - l w\\^ = WJjPp^^wW^ 



It' 



p (e+\)(N-A) y p 

2__C2Z_ , +1 

- p(e+i)(N-3) LVV J ' -J 

Hence the proof will be complete if we can show that (the term \\<p p ,Nd N ~ l w\\o is easier to 
treat) 

\\(d^ N )d^ W . < §^ [iN -3V.] M - (2-15) 



" f+T P 



Setting pi = N p , then for any k >2, 



(p puk = l, on S pi , 
which implies that ip Pu k = 1 on the Supp ^ c B pi for any k > 2. From (12.101) . we have 

(dVp.wjd^w ^ - ] Md l <p p , N )<p PuN -id N ~ } - 



w 



7+T 1 



On the other hand, the induction assumption with m = N- l,j = £,0<pi < 1, yields 

Setting now pi - ^ffi' , then for any k > 2, 

^p ljk = 1, on Bp 15 
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which implies that (p pu u = 1 on the Supp <p Pu n c B pi for any k > 2. The induction 
assumption with m = N - 3, j = 0, < p\ < 1, yields 



aa 4 — 

P 



\\(fi Pl ,N-id N V|| 



NY** 
P 
N 
P 



\\<P Pl ,N-id 2 iPp l ,N-3d N 3 w|| 

||^p,,iV-3^" 3 w|| 2 



'N-5 



1 :[(N-6)\] M 



Pi 



where we have used the fact that 



3(£ + 1) - 4 + 



+ 1 



> 0, V € > 0. 



Therefore, we get (127131) with C 4 = C 5 (0) m + 2Q, and finally for all < p < 1, 

T N-2 

if we choose 



d s A 2 M (p Pt Nd N w q + k'^dfA 2 M<p p , N d N w 

T N-2 



(2.16) 



^+l)(iV-3) 1 

,l/2/~f+l, 



P U 

L>2C^ Z (2< +1 C 2 + C 4 ). 



We prove now that (12.111) is true for m-N and j = y'o + 1 if it is true (or m = N and 

< j < j . We apply dH with r = 2 + ^ and v = cp pM d N w e C~(fl), 

H^v^wlP , 0+1 +\\dA 2+ ^V P Md N M\l + \\kW t A 2+ & iP p,Nd N w\\ 2 

2+ f+i 

< C 3 jUX^/v^wll^TtH + \\<fip,Nd N w\\l 



Firstly, 



tN-4 m 

\\<Pp, N d N M\l < 11^,^-2^-^112 < „ M+lw . 5) ((N-5y) 



Pi 



< e 



2(f+l) 



'N-4 



((N-5)l) . 



Now for the term \\Jjp p ^d w|L /„-i , we are exactly in the hypothesis of Lemma [2781 
(12.131 ) implies that 



.2+ 



2+7 



e+UrN-3 



< c 



1/2 (C 1+ ^ +i )L- 



P ! 



,(M-l)(iV-3) 



A/ 



;'o+l 



- ((iV-3)!) 



Finally, if we choose 

L > maxjMi, 2C l 3 /2 (2 M C 2 + C 4 ), Cj /2 (Ci + , 
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we get the validity of (12.111 ) for j — jo + 1 , and hence for all < j < I + 1 . Thus the proof 
of Proposition I2.6l is completed. □ 

3. Gevrey regularity of solutions for Monge-Ampere equations 

In this section we prove Theorem ll.il In the following discussions, we always assume 
u(x,y) is a smooth solution of the Monge-Ampere equation (11.21 ) and u yy > in Q., a 
neighborhood of the origin. 

We first introduce the classic partial Legendre transformation (e.g. |[l6l ) to translate the 
Gevrey regularity problem to the divergence form quasi-linear equation (I2.ll ). Define the 
transformation T : (x,y) — > (s, t) by setting 



It is easy to verify that 

Jt -- 

and 

Thus if u e C°° and u yy > in Q., then the transformations 

T : Q. — > r(O), T~ l : T{Q) — > Q 

are C°° diffeomorphism. In (9]|, P- Guan proved that if u(x, y) € C 1, (Q) is a weak solution 
of the Monge-Ampere equation (11.21) and w yv > in Q., then yC^, t) € C ' ! (7\0)) is a weak 
solution of equation 

d ss y + d\k{s,y{s,t))d t y} = 0. (3.2) 

He proved also the smoothness of y(s, t) e C°°(T(Q,)) and m € C°°(£l). 

We prove now the following theorem which, together with Theorem l2.ll implies imme- 
diately Theorem ll.il 

Theorem 3.1. Let y(s, t) € G M (T(Q.)) be a solution of equation H3.2\l . Assume that 
k(x,y) € G m (fi). Then u(x,y) e G M (Q.) . 

We begin with the following results, which can be found in Rodino's book [14] (page 
21). 

Lemma 3.2. If g(z),h(z) e G e+l {U), then (gh)(z) € G M (U) , and moreover ^ € 

G M (U) ifg{z) + 0. IfH € G M {Q) and the mapping v : U — > Q is G M {U), then 
H{v{-)) € G M (U). 

We study now the stability of Gevrey regularity by non linear composition. The follow- 
ing result is due to Friedman fTl . 

Lemma 3.3 (Lemma 1 of (71). Let Mj be a sequence of positive numbers satisfying the 
following monotonicity condition: 

/' MfMj-i < C*Mj, (i = 1,2, • • • , j; j = 1,2, • • •) (3.3) 
v.(]-iy. 



x, 



X s Xt 



(3.1) 
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with C* a constant. Let F(z,p) be a smooth function defined on Q, x (-b,b) c R 2 x R 
satisfying that, for some constant C, 

max to>(z )jP )| < cM +! M| rh2 M,_ 2 , 

for all yeZ^.i eZ + vvzY/z \y\ ,i >2. Then there exist two constants C, C*, depending only 

on the above constants C* and C, such that for every Hq,H\ > 1 with Hi > CHq, if the 

smooth function £(z) satisfies that max \£(z)\ < b and that 

zefi 



max 

zeB 

max 

zeB 



<9^(z) < Ho, /or /3wi* 10 < 1, (3-4) 
tiP&z) < HQHf~ 2 M]^-2, for all pel 2 with 2<\p\<N, (3.5) 

where N > 2 is a given integer, then for all a e Z 2 w/?/z \a\ = N, 
max\d% (F(z,Z(z)))\ < CM Hf~ 2 M N . 2 . 

Remark 3.4. Under the same assumptions as the above lemma, if we replace A3. 4\ and 
A3.5\ . respectively, by 

max fe(z)| < H , for m < 1, 

max (z)| < H H^~ 2 M m - 2 , for all m e Z + wifft 2 <m < N, 

with 1 < i <2 some fixed integer and N > 2 a given integer, then 
max Id* (F(z,f(z)))| < CMoH N y ~ 2 M N - 2 . 

We prepare firstly two propositions. In the follows, let K be any fixed compact subset 
of Q. 

Proposition 3.5. Assume that y(s,t) e G (T(£l)) and k(x,y) e G e+1 (Q.), then the func- 
tions F m (s, t) e G M (7\Q)) ,m = 1, 2, 3, w/iere 

Fi(j, = (w^ o T~ l )(s, t) = u xy (x(s, t),y(s, t)), 

F 2 (s, t) = (u xx o T _1 )(5, t) = u xx (x(s, t),y(s, t)), 



and 



F 3 (S, t) = (Uyy O T l )(S, t) = Uyy(x(S, t),y(S, t)) . 



Proof. Indeed, since y(s, t) e G e+[ (T(Q)) , then we conclude y s (s, t), y t {s.t) e G M (7\Q)) ; 
that is 

u xy (x(s,t),y(s,t)) 1 
u yy (x(s, t), y(s, t)) u yy (x(s, t) , y(s , tj) 

Lemma EPl yields that F 3 (s,t), Fi(s,t) e G e+[ (T(Q.)). Moreover, the fact that k(x,y) e 
G M {Q) and x(s, t) = s,y(s, t) e G M {T{Q)) , implies k(s,y(s, t)) e G M (T(Q.)), we have, 
in view of the equation (I1.2I ). 

F 2 (s, t) = u xx (x(s, t),y(s, 0) e G M (T(Q)) . 

This gives the conclusion. □ 
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As a consequence of the above proposition, there exists a constant M*, depending only 
on the Gevrey constants of k(x,y) and y(s, t), such that for all i, j € Z + with i, j > 2, 



max 

U,t)eT(K) 



afr}F m (s,t) <M i ; ] [{i-2)T l [{j-2)T\ m= 1,2,3. (3.6) 



Proposition 3.6. Assume that y(s, t) € G e+l (T(Q.)) and k(x,y) e G e+l (Q.). There exists a 
constant At, depending only on the Gevrey constants of the functions y(s,t) and k(x,y), 
such that for all i > 2, 

max |flUy(x,y)| + max |<9>*0,;y)| < 2[u] 3 rAf*~ 2 [(i - 2)!] m . (3.7) 

(jc,y)eA' (jc,y)eAT 

Proof. We first use induction on integer / to show that 

max |4ify(JC,y)| < [«] 3 /fAf'" 2 [(j - 2)!] w , i > 2. (3.8) 

(x,y)eA' 



Obviously, (13.81) is valid for i = 2. Now assuming 
max |t^-M y (x,)0| ^ ["li s-^'"' 

(x,y)eK 

with Af > 2 an integer, we need to show that 



max |4i*y(x,y)| < M 3 ^At'" 2 ((i - 2)!/ +1 , for aU 2 < i < N (3.9) 



max \d" +1 u y (x,y)\ = max |fl*B„(jc,y)| < [b] 3 gM^^N - 1)!] M . (3.10) 

Observe that Fi = w^, o T _1 which implies 

Uxy(x,y) = (Fi o T)(x,y) = Fi(x, w y (x, y)). 
Thus the desired estimate (13.101 ) will follow if we can prove 

max d%[Fi(x,u Y (.x,y))]\ < [u] 3 K M N ' l [(N - l)\] e+l . (3.11) 

In the following we shall apply Remark l3~4l to deduce the above estimate. 
Define 

Mj = U\? + \ H Q = [u] 3JC , Hi - M. 
Clearly {M ; j satisfies the monotonicity condition (13.31) . Furthermore, ( 13.91 ) and (13.61) yield 

max d'w v (x,y) < Hq, for / < 1, 

max |o4%(x,y)| < H H\~ 2 Mi- 2 , for all i with 2 < i < N, 

(x,y)eK 

and 



max 

( S ,t)eT(K) 



d l s d J t Fx(s, t) < M'; J M^ 2 M h 2, for all i, j e N with i, j > 2. 



Then it follows from the above three inequalities that the conditions in Remark 13.41 are 
satisfied, with z\ - x,%{z) = u y (x,y) and F(z,£(z)) = Fi(x, u y (x,y)). This yields 



max 

(x,y)eK 



3 N x [Fi (x,u y (x,y))]\ < CMqH»- 2 M N - 2 

= C t [u] 3K M N - 2 [(N-2)\f 



with C* a constant depending only on M t and hence on the Gevrey constants of y(s, t) and 
k(x,y). Then estimate (13.111 ) follows if we choose M large enough such that M > C*. This 
completes the proof of (13.81) . 
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Now it remains to prove 



max \d\u x (x,y)\ < [u] 3 K M~ 2 [(i - 2)lf +1 , i > 2. 

(x,y)eK 



This can be deduce similarly as above. In view of (13.81) and (13.61) . we can use Remark 13341 
with z = (x,y),Zi = x,g(z) - u y {x,y) and F(z,g(z)) - F2(x,u y (x,y)), to obtain the above 
estimate. □ 

End of the proof of Theorem 13. II Now we can show u e G e+l (Q), i.e., 

max \d a u(x,y)\ < 2[w] 3 * AT -3 [(m - 3)!l f+1 , V \a\ = m > 3, (3.12) 



where M is the constant given in (13.71) . 

We use induction on m. The validity of (13.121 ) for m = 3 is obvious. Assuming, for some 
positive integer nio > 4, 

max \d y u(x,y)\ < 2[u] 3 srAT" 3 [(m - 3)!] m , V 3 < \y\ = m < m - 1. (3.13) 

(x,y)eK 1 1 

we need to show the validity of (13.121) for m = niQ. In the following discussions, let a be 



any fixed multi-index with |a| = m®. In view of (13.71) . we only need to consider the case 
when d a = d a dy with a a multi-index satisfying \a\ = mo - 2. Observe F3 - u yy o T^ 1 
which implies 

u yy {x,y) = (F 3 o T)(x,y) = F 3 (x,u y (x,y)). 

Hence 

d a u = d a u yy = d a [F^(x, u y (x,y))], \a\ = mo -2. 
So the validity of (13.121 ) for m - tuq will follow if we show that, for any \a\ = mo - 2, 

max \d & [F 3 (x,u Y (x,y))]\ < 2[u] XK M m °- 3 [(m - 3)!] m (3.14) 



To obtain the above estimate, we take Mj, Hq, H\ as in the proof of Proposition [X6J that is 

Mj = (jl) M , H = [u] 3K , H l= M. 
Then from (13.61) and the induction assumption (13- 13b . one has 
max |d r Wy(x,)/)| < 2Hq, for |y| = m < 1, 

(x,y)eK 

max |5 r w y (x,y)| < 2H H" l ~ 2 M m - 2 , for all 2 < \y\ = m < m - 2, 

(x,y)eK 

and 



max 

U,t)eT(K) 



d' s djF 3 (s, t) < M" J M^ 2 M h2 , for all i, j e N with i, j > 2. 



Consequently, Lemma [331 with z = (x,y),g(z) = u y (x,y),N - mo - 2 and F(z,%(z)) 
F 3 (x, u y (x,y)), yields for any \a\ = mo - 2 



max 

(x,y)eK 



d & [F 3 (x, u y (x,y)) ]| < 2CH H^- 4 M m „ 4 

= 2C[u] XK M m «- 4 [(m -4)\] e+l , 



where C is a constant depending only the Gevrey constants of k(x,y) and y(s, t). Thus 
(13.141) follows if we choose M large enough such that M > 2C. This gives validity of 
(13.121) for m = mo and hence for all m > 3, completing the proof of Theorem 13. 11 
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4. Technical lemmas 

In this section, we prove the technical Lemmas( Lemma 12.81 and Lemma 12.91 ) used in 
the section [2 Firstly as an analogue of Lemma 1331 we have 

Lemma 4.1. Let N > 4 and < p < I be given. Let {Mj) be a positive sequence satisfying 
the monotonicity condition f lj.il ) and that 

Mj > p~ j , j > 0. 

Suppose F(s, t,p),g(s, t) are two smooth functions satisfying the following two conditions: 

1 ) There exists a constant C such that for any j, I > 2, 

KMlcHM-m) * cJ+lM J-2Mi-2, v iri = j, 

where b = [g] Q jj and IHIc 4 (Bx[-fc,fc]) & tne standard Horder norm. 

2) There exist two constants Hq,H\ > 1, satisfying H\ > CHq with C a constant de- 
pending only on the above constant C, such that [g] 6 # < Hq and for any < p* < 1 with 
p* ~ p and any j, 2 < j < N, 

ll^j^Hv < H Q H{- 2 M h2 , 

where 1 < v < 4 is a real number. 

Then there exists a constant C* depending only on C, such that 

\\<p p , N d N (F(;g(-))) I < CMoH?- 2 M N . 2 . 

Proof. The proof is similar to Lemma 5.3 of 0, so we give only main idea of the proof 
here. In the proof, we use C n to denote constants which depend only on n and may be 
different in different contexts. By Faa di Bruno' formula, <p p ,ND a [F(-,g(-))] is the linear 
combination of terms of the form 

/ 

<P P ,N{dP/ p F)(;g(-))-Y\d*g, (4.1) 

where \f3\ + l < \a\ and y\ + yi + • • • + yi = a -ft, and if y,- = 0, D yi g doesn't appear in (14. II ). 
Since H V (M?) for v > 1 is an algebra, then we have 

/ 

\\<Pp,N(dP/ p F)(;g(-))-Y\d*g\\ y 

^lkK^)o^o))|| v -nikir/^IL' 

7=1 

where i/> € C^°(K. 2 ) and iff = 1 on supp <p p ,N- The above inequality allows us to adopt the 
approach used by Friedman to prove Lemma 13.31 to get the desired estimate. Instead of 
the L°° norm in Lemma 1331 we use // v -norm here. But there is no additional difficulty 
since H y (R 2 ) is an algebra. We refer to [7 ] for more detail. □ 

def ~ def 

Applying the above result to the functions k(s, t) = k(s, w(s, t)) and k w (s, t) - k y (s, w(s, t)), 
we have 

Corollary 4.2. Let No > 4 and jo € [0, £ + 1] be any given integers. Suppose k(x,y) e 
G f+1 (R 2 ) and w(s, t) e C°°{B) satisfying that for all 5 < m < No and all p with < p < 1, 

Ik^HLfeL ^ J [(m-m M , (4-2) 
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where L, c* are two constants with c* independent of L. Then there exists a constant c, 
depending only on the Gevrey constants ofk,w, and the above constant c*, such that for 
all 5 < m < Nq and all p with < p < 1 , 

||yp,md'"£|L ; -l + \\<Pp, m d m k w ^-1 (4.3) 

cL" 1 " 2 ( m V° 



-I [(m-3)!] f+1 . 



Proof. We set //q - c* ([w] g g + lj ,H\ - L and 



= 1 „ _ [(j-l)!]' +1 /j + 2^ 

Then by (14.21) . we have 



|k, m d m w|L y -i < H H™ 2 M m - 2 , 2<m< N . 
z+ e+i 

On the other hand, the fact that Jk e G f+1 (R 2 ), fcy e G m (R 2 ) and Mj > [(j- implies 
H^s^x, )0|| C 4 (n) + \\ff x d J y k y (x, y)\\ c4(Q) < C i+j M^ 2 Mj. 2 , V i, j > 2, 



where C is the Gevrey constant of k. Then by Lemma I47U the desired inequality (14.31 ) will 
follow if we show that {MA satisfies the mono tonicity condition (I3.3I ). For every < i < j, 
we compute 



j! ((i - / i + 2V ((/ - ' ~ !) ! ) + / J - i + 2 V° 



1 - m\U ~ i ~ 1)0' (i + 2\ jo (j - i + 2) jo 



p (e+DU-2) \ P ) \ P 



gt+l jf+iy-jo 



j 2 i jo-l U _ l yo-l i ((./' - 1 )!) / (j + 2^ 



0'- l/ +1 0' + 2yoj p(f+i)(y-i) \ p 

:2 ,-2(; -l) ^ {Yj _ 1 I / . 9 Wo 

< ^o/ +1 p^ +1 >--/°. 7 7 117 ' 7 ' 



0'- i/ +1 0' + 2V'oj ptf+ix/-i) \ p 

where Q is a constant depending only on I. In the last inequality we used the fact that 
t- + 1 _ jo ^ 0. This completes the proof of Corollary 14.21 □ 



We prove now the technical Lemmas of section El We present a complete proof of 
Lemma l2~8l but omit the proof of Lemma [2791 since it is similar. 

Proof of Lemma 12781 We recall the hypothesis of Lemma [2781 that is, one has 

(1) £eG m (R 2 )and£w = 0; 

(2) for some N > 5, (12.111 ) is satisfied for any 5 < m < N - 1; 
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(3) for some < jo < I, 



d s A 2+! kr<p PiN d N w 



AH 



A 1 . 



~0d t h 2+ ^Lp p , N d N W 



AH 



CqL 



N-3 



P 



Xe+lXN-3) 



(N\ jo , v/+i 

(-) ((»-»') • 



(44) 



We want to prove 



W\ 



'2+Tn 1 ~ p('+i)(^-3) 



/VV 0+1 

^ (<"- 3 >0 



f+1 



(4.5) 



for all < p < 1. 

It follows from Xw = that 



£tp p , N d a w = [£, tp p , N ]d a w + <p p ,n[-C, d< *]w> M = N - 
Hence the desired estimate (14.51) will follow if we can prove that 



CiL N ~ 3 IN 



and 



CiL N ~ 3 IN 



io+i 



- [(N-m 



|or|=JV ^ ^ 



70+ 1 



f+1 



(4.6) 



(4.7) 



We shall proceed to show the above two estimates by the following steps. As a convention, 
in the sequel we use Cj to denote different constants independent of L, N. 

Step 1. We claim 



lk^ m Hlo * 



CiL 



AT-3 



n «+l)(/V-3) 



-2(/+l) 



[(N-3)!] m , V3<m<N. (4.8) 



To confirm this, we set p = < - m J )p _ Then 

||^p,m<9 m w|| = \\<Pp, m d 2 <Pp,m-2d m ~ 2 u\\ < \\ip Ptin - 2 d m ~ 2 u\\ 2 

we can use (12.111) with j = to compute 

Wm-2)-2 

||^-2^- 2 M || 2 < ^ +1X0B _ 2) _ 3) [((m - 2) - 3)f +1 

/o rN-A 

< — =r[(m-5)!] 



P 



,(f+l)(m-5) 



A/ 



-2(f+l) „ ,#-3 

CoL [(/Y-3)!f +1 , 



P 



,tf+l)(/V-3) 



which implies (14.81) at once. 

Step 2. In this step, we shall prove the following two inequalities: 



and 



|(dfVp,Ar)£d f d Ar w 
(di¥>p,/\r) d s d N w 



C 2 L 



N-3 



A/ 



;'o+i 



- [(iV-3)!] 



C3L 



N-3 



2+Tn 1 " p( /+1 X^-3) \p 



/vv' 0+1 

- [(/V-3)!]^. 



(4.9) 
(4.10) 
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To prove the first inequality ( 14.91 ), we use (12.101) to get 

\\(dt<Pp,N)kd t d N w\\ 2+ j -i = \\(d t <pp, N )kd t ip PuN d N w\ 



z+ e+i 



3+ 



AH 



N) M 



Furthermore, the interpolation inequality (12.31) gives 
\\kdtip Pl ,Nd N w\\ 



N 



P 



— \\\kd t tp puN d ! ' 



w h+^ + \~ 



N 



4+ 



(N \ / NY M 

— I \\kd t (p Pl ^d N w\\ 2+ ja_^ + C 5 1 — 1 H^^^wIIq 



AH 



4+- 



\kd t (p puN d w\ 



N 



— \\\kd t tp pltN d ! ' 



where we have used (14.81 ) and A~ l kd t is bounded in L 2 . On the other hand, note that 



\\kd,<pp, N d N w\\ jo-i < 

<C 7 

which together with (14.41 ) yields: 



kd t A 2+ ^<p pM d"w 



AH 



+ 



k?d t A 2+ -7TTip p , N d"w 



[k, A 2+! ^]d t <p pM d N w 
+ \\<Pp, N d N w\\ 2 A, 



\\kd t (pp >N d N w\\ 2+ j s -i < 



7tr ~p(/+iXV-3) \ p 



-I [(AT-3)!]^ 1 , 



and hence we obtain the desired inequality (14.91 ). combining the above inequalities. Similar 
arguments can be applied to prove (14. 10b . This completes the proof. 

Step 3. We now claim that 

(d^p.jv) d^w ? ,0-1 + 11(5^,^)^ 



w 



2+i 



- p (M)(N-3) \ p ) -Vj - 



(4.11) 



To confirm this, we use (12.101 ) to get 



w 



2+- 



GEVREY REGULARITY 17 

The interpolation inequality (12.31 ) yields 

The above two inequalities, together with (14.41 ) and (14.8b . give the desired estimate (14.1 II) 
at once. 



Step 4. Now we are ready to prove (14.61) . the estimate on the commutator of £, with the 
cut-off function <p p j/. Firstly, one has 

[£, <p p>N ] =2 (d s (p PtN ) d s + (d ss tp PtN j + 2 (d t (p P)N ) kd, 
+ (dtt<P P ,N) k + (d t <P P ,N) (d t k) ■ 

Observe that 



(d t ^ p , N )(d 1 k)d N w _, ^Cnjl-jll^,^ 



N M\ j 

\\2+ J - 



; N v ~ ii *n ii \ 

+ 1-1 WpunQ w|| ), 



hence from (14.41 ) and (14.81 ). we have 

Together with (14.9b . (14.101) and (14.111) . this yields the desired estimate (14.61 ) at once. 

Step 5. In this step we shall deal with the non linear terms, and prove 

C L N ~ 3 ( N\j° +l 
|k*^|| 2+ ^ < (-J [(N - 3)\] M . (4.12) 

Recall ILpiyflfd^ll / -i = 2Z\a\=N \\ ( Pp,N^td a k\\ r} j Q -i ■ Leibniz's formula gives, for any 

112+ f+1 • 112+ f+1 

a with \a\ = N, 



9 P ,Nd,d a k = Yj UVpA^h) (dtd^w) + <p p , N k w d t ff*w 
1<P<H W 

= J] hifi P A^h){dtd a ^w) + ^ N k w d t d a w + R a 



5<^<M-4 

with k w (s, t) - k w (s, w(s, t))) and 



1<LS|<4 b|-3<|B|<|or| 



18 H. CHEN, W.-X. LI, AND C.-J. XU 

Since H K (R 2 ), k > 1 is an algebra, we have 



Z Z (j||^(^)(^-M|| 2+ ^ 

a\=N 5<|/?|<|a-|-4 M 

- Z Eft lki^w|| 2+ ;ozI IkpM^wH^^, 
H=iV 5<L6|<H-4 ^' ' 



M=iV 5<t6|<|o-| 

N ~ 4 AH 



* 2 /!(jV-/)' hpuA\\ 2+ i£ \WnO 



i=5 



z+ f+i 



We can use (14.31 ) in Corollary 14.21 to get for each i with 5 < i < m 



, c l5 u- 2 (0* 



-I [(/-3)!f +1 . 



Observing Af - i + 1 < Af for each i > 1 , we use (14.81) and the induction assumptions (12.111) 
and (14.41 ). to compute 



N\ 2+ < 



m 
/o-i 



ll^_ i+1 ^- <+1 w ll ) 
< y PuN - i+ ^4 2+ , + (^i) 70 [( iv - * - 2).]- 1 
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Then 



2 2 i% P ^)(d^w) 

\a\=N 5<|/3|<|a|-4 



\a\=N 5<t6|<| 

"j!(A^-0!p^ +1)( '- 3) \p 



< V Ci 5 U- 2 ji\ JO 

- Zj ;irv-ft!n(«+ixi-3)LJ lKl ; ' J 



5</<iV-4 

Af-i-1 / at _ ; _■_ 1 Wo 



Cie^"'" 1 N-i+l 



r #-3 /at\ 2 Jo 



< C^/A^y- 1 y (AT -5)!A^°-i> f 



5<i<N-4 



Here the last inequality holds since 4 + jo - 2{£ + 1) < 2. Moreover, observing that the 
series Yj -, 2 is dominated from above by a constant independent of N, then we 



5<i<N-4 

get 



2 2 (")iw^w)(^w)n 2+ ^ 

\a\=N 5<L6|<|Qf|-4 ^' 



\a\=N 5<\fS\<\a\ 

C 2 pL N - 3 (N\ }0+1 m 
~ p (M)(N-3)\ p ) J;,J ■ 

It's a straightforward verification to prove that 

'N-3 / w \Jo+l 



\a\=N 

So we have proved that 



M=iV 1<|/3|<M ^ f+1 



AT-3 /Af\io+ 1 



- [(iV-3)!] 



f+1 



Observe ||y p ,i\r^^ Ar ^l| 2H jq- [ * s bounded from above by 

2 2 («) fpA^k v )(d t d a ^w) 2+J ^ + \\<p p , N hd t d N w\\ 2+i o^. 

\a\=N l<\/3\<\a\\P> + M 
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So to get the desired estimates (14.121 ) it remains to estimate the last term above. Direct 
calculations yield that 

\\<Pp,Nkwd t d N w\\ ;„-i = \\(p p ,Nk w dtip puN (Fw\\ ; -i 
< C 23 {llLA 2+ ^ L ^ Pl ,^ iV w||o + \\[k w , h 2+1J £}d t <p PuN d N w\\ Q 



. 1,1 



+ I '— I Pwdf^pL/vd^vvllo 



2+7TT 



+ 1- M ll^^wll! 



< C 2 ^\k w A 2 ^d t <p PuN d N wh + \\9 Pl ,Nd N w\ 



z+ f+i 



(2f+J0+0 2 



+ 1-1 ll^.^wllo). 
In the last inequality we used the interpolation inequality (I2.3I ). Combining the fact that 
W*,w)l < C(sup ^.w)!)' {k{s,w)y , 

w<eR 

which can be deduced from the nonnegativity of k(s, w), we obtain 

\\y p ,NK{s,w)d t d 

< C 2 6{ll^A 2+ ^^ Pl , w 3 A, w||o + \\<P Pl ,Nd N w\\ ?+M _ 

y ' " c+i 

(2C+j 0+ l) 2 
AT\(f+D(;o+0 ^ nN 



+ 1-1 IIVpi^wo) (4-14) 



p(f+l)(|a|-3) y p 

the last inequality following from (14.41 ) and (14.81) . The proof is thus completed. 



Step 6. Now we prepare to prove the inequality (I4.7I ). the estimate on the commutator 
of X with the differential operator d°. Direct verification yields 

[£,<?> = - J] h(d^~k)(d t ^w)- J] 

0</3<o- 0<fi<a 

So 

2 ||^,iv[X, df]w\ 2+tL± < 5i + S 2 (4.15) 

\a\=N M 

with »Si, S2 given by 

\a\=N 0</3<a f+1 
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and 

W=iV 0<y3<ff ^ f+1 

For »Si, we have treated the term of /? = a by (14.121 ). and the terms of < /? < a can be 
deduced similarly to (14.131 ): this gives 



For ^2, we have treated the term of = 1 by (14. 14b . and the terms of 2 < |/?| < \a\ can be 
deduced similarly to (14.131 ): this gives also 



p (^+l)(JV-3) y p 

This complete the proof of Lemma [2781 □ 
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